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THE PROBLEM 



Much research and educational programming concerning emotionally 
disturbed children contains the implicit assumption that these children 
are sufficiently homogeneous ' to justify their being grouped without 
further reference to possibly meaningful differences within this category. 
To what extent is this assumption tenable? Within the clinical field it 
has long been the practice to differentially diagnose behavior disorders 
according to a particular system £ e ,g. Kraepelin (1895), Fenichel (1945), 
American Psychiatric Association (l952)j but these systems have not been 
utilized productively as far as classroom practice is concerned. 

A major reason for such lack has been the poor reliability of 
classificatory schemas (Eiduson et al, 1966) . In one study 
(Rabinovitch, 1964) which attempted to measure differences in achieve- 
ment as a function of differential diagnosis, questionable reliability 
of the classification schema casts doubt on the differential achieve- 
ment findings. On the other hand, given an adequate classificatory 
system with sufficient validity and reliability, one could justifiably 
reopen the question of the efficacy of classifying disordered children 
in the school context. 

Recently Quay (1966a, 1966b, and Quay and colleagues, 1966a, 
1966b) has described a method of classifying children with behavioral 
disorders* Quay's method utilize* a behavioral checklist and shows 
promise in objectivity and reliability as well as being relevant to the 
problem of classifying children within the public school framework. 



- 2 - 



Behavioral Checklist 

Quay’s method derives from a scale first developed by 
Peterson et al (1961), The scale came from a checklist of SO re- 
ferring complaints of symptomatic behaviors for 500 caildren re- 
commended to a child guidance child* The checklist items were 'then 
subjected to factor analyses on a variety of populations and the be- 
havioral checklist was reduced to 58 items. 

The Behavior Problem Checklist (see Appendix A) categorizes 
observable behaviors and requires that the judge or rater see the 
child in living situations or take information from case histories. 

Thus, inferential attributes are minimal^ Several studies (Quay. 

.1966a, Quay, Morse and Cutler, 1966a) have shown that three independent 
dime nsions account for about two -thirds of the variance of the inter- 
relationships among the problem behaviors. 

Research reveals that the first dimension of the scale in- 
cludes aggressive, hostile behavior and is usually labelled "conduct 
..disorder," "unsocialized aggression," or "psychopathy." The second 
dimension represents anxious, depressed, intro vertive behavior, and 
is usually labelled "personality problem" or "neuroticism. " The -third 
dimension, involves disinterest, apathy,- daydreaming, and passivity. 

The. labels of "inadequacy," "immaturity,'" and "autism" have -been used 
to describe this dimension (Quay, Morse, and Cutler, 1966a). Quay. v (l 963 ) 
'has suggested that a fourth dimension — socialized delinquency — 
applies to a proportion of inner city youth who are not disturbed in the 
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classical sense, but who are at odds with middle-class schools and 
teachers. 



This socialized delinquency factor has been hypothesized 
from questionnaire and case history analyses, although Quay (1964) 
has pointed out that these items are not likely to be observed in 
schools and institutions. The scale is sufficiently rigorous to 
meet the basic tenets of science: it can be subjected to re- 

plication, item and factor analysis, reliability counts, and it can 
be used to predict. 

The ability of the Behavior Problem Checklist to dif- 
ferentiate between children stimulated the possibility of classroom 
application. This study examines the classroom behavioral concomitants 
which might be associated with the classified subgroups. 

Specifically, the study examines the following questions: 

l) What behaviors (if any) do disturbed children have in 
common, both among themselves as subgroups as well as with normal 
children? 



2) What is the extent of the consonance or homogeneity 
among behavioral attributes which characterize subgroups of disturbed 
children and are the behaviors of disturbed children (e.g. boisterousness, 
stealing, se elusiveness) related to their learning characteristics on 
such variables as IQ, reading level, and the Illinois Test of Psycho - 
linguistic Abilities (ITPA) profile? Further , what are the curricular 
implications of and suggested groupings for the patternings which emerge? 
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3) In general, ho w useful can the Behavior Problem Checklist be 
to teachers and administrators in the practice of special education? 

This study also examines another common assumption, that 
disturbed children are academically retarded. This assumption has 
been questioned by Balov; (1966). After reviewing the literature he 
stated: n A commonly accepted belief is that emotionally disturbed 

children as a group are deficient in school skills, particularly in 
reading. The evidence for the converse of this, that reading-disabled 
pupils show more maladjustment than pupils making normal progress, 
appears clear , but whether disturbed children are also disabled in 
school skills is moot (1966, p.124)." 

In regard to this issue one asks what is an appropriate 
frame of reference against which we test the child’s acac-'mic achieve- 
ment? Specifically, what subgroupings of emotionally disturbed children 
show retardation relative to expectancy? Therefore, the present study 
will also examine these questions by comparing different subgroups con- 
stituted on the basis of the Checklist against expectancies which have 
been based upon both chronological and mental age. 

In summary, the purpose of this study is to examine the 
feasibility of utilizing the Behavior Problem Checklist and academic 
and intellectual variables which are associated with subgroups of dis- 
turbed children so these subgroups can be contrasted amongst themselves 
and with normals. 
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METHOD 



Subjects 

One hundred and eight boys with various "behavioral problems 
served as subjects (Ss) in this study. The were selected from a 
residential treatment center, special classes for the emotionally dis- 
turbed in regular New York City elementary schools, and a special 
service school in New York City. Ss ages ranged from 9 to l4 years. 
Ninety per cent of the Ss were Negro or Puerto Rican. This high 
percentage reflected the population composition at the special service 
school and the residential treatment center, as well as the composition 
of the special classes in the particular areas chosen. Only boys were 
used in this investigation since boys comprise approximately 80 percent 
of the population in special classes for the emotionally handicapped 
(Morse at al. , 1964) • 

New York City Board of Education regulations forbid inquiry 
into parental occupation and social class, but the vast majority of Ss 
received free lunch and lived in census tract areas which strongly 
suggested that most Ss came from families receiving Welfare (Class VII 
on the Warner Scale, 1964). Similarly, no official records of the 
pupil’s race can be maintained so that the ethnicity of each child was 
necessarily noted visually. Specifically, Ss were selected from the 
following sources: 

1. Floyd Patterson House - Wiltwyck School for Boys (P.H.). 
The Floyd Patterson House is a residential treatment center in 



Hew York City which provides services for hoys who have not been able 
to be maintained at home, I*jost of the children were co ur t r ema n de d, 
came from the lowest social class as defined by Warner (1964) , and in 
many cases had one or more siblings who have had trouble with the law 
(Minuchin et . al , 1964) , All 23 children in residential treatment at 
the Floyd Patterson House participated in this study. 

2. Junior Guidance Classes (J.G.) of the New York City 
Board of Education. These classes are maintained by the New York 
City Board of Education for elementary school-aged emotionally dis- 
turbed children. Ss in this study were chosen from closed register 
Junior Gu i dance Classes or classes which were chosen at the beginning 
of a school year and which remained as a unit for the duration of that 
year. Closed register classes include both boys and girls and 
aggressive and withdrawn children. 

3. P*S. , a special service school (S.S.), also 

contributed Sis to this study. Originally, Ss from the special service 
school were intended as a comparison group to be contrasted with the 
samples of disturbed Ss. A Special Service School is defined by the 
New York City Board of Education as a school which, because of its 
depressed socio-economic level and multiplicity of problems, qualifies 
for extra services such as remedial reading, nursing, attendance 
officers, etc. The particular special service school used in this 
study was selected because of the willingness of its administration 

to participate in a research study. Like the Junior Guidance C la sses, 



the special service school had regular classroom teachers (3) and an 
auxiliary or cluster teacher who worked with all classes, A fourth 
and fifth grade were randomly selected from this school. After talking 
with teachers and observing classes the investigator felt that many of 
the children in the school presented problems similar in number and 
nature to those of the disturbed groups (residential treatment and 
Junior Guidance). Thus, maintaining a distinction between the two 
groups would be illogical. Children from the special service school 
were then added to the overall disturbed sample. 

To verify this impression of the special service school 
classes, three judges observed classrooms in session and agreed that 
a meaningful distinction could not be made between the special service 
school and the special classes. This observation was empirically 
verified by comparing the total mean scores on the Checklist of a 
random sample (N = 10) from the special service school with a random 
sample (N = 10) from the residential treatment center. The Mann- 
Whitney U Test (Siegel, 1956) was used with a resulting U of 51* The 
probability of such a U occurring = .726 and the null hypothesis that 
the sample from the treatment center and the special service school 
were similar could not be rejected. 

Completion of Behavior Checklist and Testing Procedure 

Each teacher involved in the study was trained, licensed, 
and had extensive educational contact with each S. It was explained 
to raters that each item on the scale (to be described in the next section) 
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■was to be checked independently of other items and teachers could not 
collaborate with their colleagues to rate 

In a number of groups two teachers rated the child 1 s behavior 
but only one rating (the classroom teacher’s) was used for the 
classification of Ss, while the rating of the auxiliary teacher was 
used to calculate the reliability of the scale. 

Previous research on the checklist has shown great stability 
for the chec kli st over time (Quay, 1964) , although previous attempts 
at establishing the checklist reliability were confounded by the lack 
of two raters seeing the same child under the same circumstances. 

While only one rater was used in this study for the statistical analysis 
(to be described) two raters were able to observe the same child in 
roughly the same circumstances (classroom behavior) in both the Junior 
Guidance classrooms as well as the special service school. According 
to the rules for the checklist, raters are to check" "0" if the specified 
behavior does not present a problem, M l" if it constitutes a minor 
problem, and ”2” if it presents a major problem. For the purposes of 
scoring, the trait is scored as 1 (present) or 0 (not present) 

(Quay, 1966c). 

Since the scoring was binary, two raters should find 
agreement with each other 50 percent of the time by chance alone. 

It was found in this study that seven pairs of raters, observing the 
same child, were able to agree on whether the child presented a 
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problem or not (irrespective of degree or magnitude) 72.4 percent of 
the time. 



When magnitude or degree is taken into account (i.e. rated 
on a 3-point scale) two raters should agree with each other 1 out of 
3 times on a chance basis alone. In this study raters agreed with 
each other 62.9 percent of the time. 

It appears that using this scale is certainly more effective 
than chance alone but its reliability still appears to be too low to 
use this instrument as a measure of an individual child’s performance. 
Its cluster content is quite high; that is, it appears that if a judge 
checks certain items on an individual child he will also check other 
items which will form a cluster, but it does not appear that judges can 
yet agree with a very high degree of reliability on whether item X or 
Y constitutes a problem for a particular child. There is a great need 
for sharpening the parameters of the instrument, so that behavior is 
more accurately described as a major or minor problem. This would 
then reduce the subjective factor of what constitutes a problem and 
would make the instrument more feasible for individual children. 
However, the instrument does appear adequate to use with groups. 

After each teacher (N=ll) filled out the behavioral checklist 
on S£ in their classes, each S was then tested individually on achieve- 
ment and intelligence tests. Most testing was done by second-year 
graduate students in educational psychology who had completed one year 
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of supervised individual testing and who had at least two years of 
teaching experience. In addition, some testing was done by the 
principal investigator. After the individual testing, groups were 
then tested with achievement batteries. Testing was done by the re- 
search assistants with the classroom teachers in the rooms , 

The battery of psychological tests was privately administered 
in two parts, each lasting approximately 90 minutes. 

Testing and completion of the behavioral checklist were 
done after teachers had been able to observe and work with children for 
at least a three -month period. All testing was accomplished within 
two months of the initial classification. 

Psychoeducational Measures 

Intelligence . In addition to the beha.vioral scales, all 
subjects were tested for intelligence on the Peabody Picture Vocabulary 
Test (PPVT). This test is particularly effective in establishing 
rapport, and does not penalize Ss handicapped in reading. It is 
sufficiently valid and reliable for classificatory purposes. Thus, it 
can substitute for tne more time-consuming and difficult to administer 
WISC (Graubard, l$ 6 ' 7 s HImmelstein and Herndon, 1962). 

Based on oral reading scores, classes were also administered 
the appropriate form of the California Test of Mental Maturity (Short 
Form) (1962) . The California Test of Mental Maturity was chosen as a 
% " complement to the PPVT because it is a measure covering both a wide and 

specified range of mental functioning. Therefore, a patterning of cog- 
nitive abilities was ascertained rather than simply a global IQ score. 



The California Test of Mental Ifeturity provides the following scores: 



1. logical reasoning 

2. numerical reasoning 

3 . Verbal concepts 

4. Memory 

5. language total 

6. Non-language total 

7. Total 



Reading . Each S was administered the Word Recognition and 
Listening Comprehension section of the Spache Diagnostic Reading Scale 



(1963). The Spache was chosen because its norms are recent and it has 



been judged (Buros, 1966) as being one of the best instruments available 



to test reading skills. It was also felt that an oral reading test 



would eliminate the necessity of giving standardized reading tests to 



non-readers and having them receive misleading scores because of re- 



quired extrapolation scores. 



Classes were also given the appropriate form of the 
California Reading Test after their individual Spache Word Recognition 
scores had been determined, S£ who read on a third-grade level or above 
were given the elementary form of the California Reading Test which 
yields the following scores: 

1. Reading Vocabulary 

2. Reading Comprehension 

3. Total Reading 

Ss below that level were given the primary form. 






ti: 



h 



- 12 - 



The following table shows the Group, CA, 3Q, Reading level. 



and source of referral for the 108 hoys: 



Table 1 



S Group 


CA in months 72£?3fP±VT) Reading (Calaf .) 

in months 


Comp. 


Origin 


104 1 


112 


101 


108 


S.S. 


108 


H5 


70 


106 


S .3 • 


103 


121 


109 


98 


S.S. 


014 


98 


83 


64 


J .G. 


017 


115 


107 


108 


J.G. 


094 


112 


no 


112 


s «s • 


✓ 

056 


152 


90 


154 


P.H. 


no 


109 


93 


133 


S.S . 


063 


133 


85 


64 

A* 


P.H. 


065 


123 


95 


81 


P.H. 


009 


107 


81 


85 


J .G. 


023 


98 


100 


82 


J.G. 


102 


125 


130 


102 


S «S . 


o64 


123 


7* 


85 


P.H. 


M 


116 


95 


97 




S.D. 


33.3 


15.9 


23.24 






004 2 


88 


83 


008 


9^ 


88 


018 


103 


98 


050 


332 


94 


006 


86 


87 


c6i 


133 


78 


005 


95 


88 


079 


335 


71 


085 


122 


91 


007 


87 


104 


062 


332 


77 


071 


157 


73 


059 


159 


67 


m 


123 


95 


002 


100 


81 


022 


97 _ _ 


107 


M 


n4 


86 


S.D. 


24.0 


n 



64 


J.G. 


78 


J .G. 


86 


J.G. 


87 


J.G. 


75 


J.C-. 


75 


P.H. 


88 


J.G. 


102 


S.S. 


106 


S.S. 


64 


J.G. 


78 


P.H. 


in 


P.H. 


91 


P.H. 


88 


S.S. 


75 


J.G. 


78 


J.G. 



84 

33.6 



/• 



o 
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Table 1 (Cont’d) 




s 


Group 


CA in montbs 


Ift (pjevt) 


Reading (Calif.) Comp. 


Origin 










in montbs 




099 


3 


118 


74 


106 


s.s. 


101 




112 


85 


97 


s.s. 


044 




io4 


96 


78 


J.G. 


043 




100 


111 


75 


J.G. 


083 




127 


71 


119 


S.S. 


107 




111 


113 


113 


S.S. 


105 




129 


75 


107 


S.S. 


097 




120 


93 


108 


S.S. 


106 




113 


76 


93 


S.S. 


037 




98 


113 


81 


J.G. 


096 




116 


84 


108 


S.S. 


027 




90 


83 


64 


J.G. 


080 




139 


86 


106 


S.S. 


067 




124 


84 


101 


P.H. 


M 




114 


89 


97 




S.D. 




13.3 


l4.4 


16.3 




0l6 


4 


109 


93 


106 


J.G. 


028 




85 


85 


82 


J.G. 


047 




125 


82 


92 


J.G. 


Oil 




108 


101 


82 


J.G. 


049 




134 


98 


104 


J.G. 


013 




99 


123 


104 


J.G. 


026 




95 


93 


64 


J.G. 


075 




118 


105 


86 


P.H. 


077 




108 


91 


88 


P.H. 


038 




115 


96 


104 


J.G. 


045 




103 


90 


98 


J.G. 


010 




109 


86 


82 


J.G. 


054 




121 


85 


87 


J.G. 


025 




84 


98 


81 


J.G. 


091 




131 


95 


104 


S.S. 


048 




120 


no 


82 


J.G. 


029 




94 


92 


86 


J.G. 


078 




l4o 


124 


102 


P.H* 


o4o 




107 


80 


78 


J .G. 


053 




122 


77 


85 


J.G. 


051 




i4o 


56 


81 


J.G. 


034 




116 


90 


98 


J.G. 


M 




113 


93 


90 




S.D. 




15.9 


l4.6 


11.2 



fi ' 

i W 



er|c 



] 



i 
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Erocedures for Data Analysis 

Checklist . Since the purpose of the study was to ascertain 
if Ss with si mi l a r "behavior profiles also showed similar psychoeducational 
problems, the first step of this investigation involved the assignment 
of discrete behavioral categories to Ss. It has been shown (Quay, Morse, 
and Cutler , 1966a) that it is possible to grossly categorize Ss thro ug h 
statistical analysis and three independent factors can be isolated. 

It might have been possible to place Ss in categories by sorting them 
according to their falling one or more SD’s above the mean in one 
category, and one SD below the mean in other categories. The difficulty 
with this procedure is that "mixed" cases and Ss who did not show extreme 
scores on only one factor would have had to be excluded from the analysis. 

Fortunately, Cohen (1966) has provided a method which seems 
eminently suitable to the Quay Checklist data collected in this study. 

The method, known coincidentally as Q-.analysis , is a version of an 
earlier factor -analytic technique and has been developed for marketing 
application. In Q-analysis, item responses are correlated and factor- 
analyzed across Ss rather than across tests. Therefore, factors reflect 
extracted commonalities among individuals, yielding an empirical typology. 
Cohen’s approach makes optimal use of high-speed computer applications 
to facilitate the analysis which, if analyzed by other approaches (£.g. 
hand and desk calculator) are extremely unwieldly and impractical. 
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Achievement and intelligence measures . All achievement and 
intelligence scores were converted to age equivalencies, so that all 
subsequent comparisons would be made on a common basis. 

In order to gain further understanding of the process or 
purported components of achievement, a proportionate sample of Ss were 
then randomly chosen from each of the subgroups for further study. 

A clinical model of the reading process was used for this 
analysis. The model to be used was initially devised by Kiass (1962) 
and used by Graubard (1965) and in this analysis theoretical expectancy 
was opposed to actual achievement along the dimensions of this com- 
munication model. This model is shown in Figure 1. 

The model is based on the Illinois Test of Psycholinguistic 
Abilities (ITPA) (1961) which was developed to help identify psycho - 
linguistic abilities and deficits in children. The theoretical base 
for this test is described in detail by Kirk and McCarthy (1961). The 
ITEft. follows a model of the communication process postulated by 
Osgood (1957). It consists of nine subtests, six at the representational 
or meaningful level, and three at the automatic-sequential level. At 
the representational or meaningful level, each pro cess --decoding, 
association, and encoding is tested via the channel necessary to 
accomplish tasks: auditory or visual input or decoding, visual-motor or 
auditory-vocal association, and motor or vocal output or decoding. 

At the automatic-sequential level, tests were not devised to 
assay decoding, association, and encoding because of lack of theoretical 



clarity at this level. Nevertheless, the automatic-sequential aspects 
of language are essential and these tests tap auditory and visual 
memory as well as organizational ability and syntax. McCarthy and 
Kirk (1963) provide a complete description of the test and its properties. 
Because this test examines processes, it has vast potential for dis- 
covering and differentiating attributes of various populations. 

Statistical evidence which relates chronological age, mental 
age, and social class to the ITEA. is reported in the test manual (1961). 
Kass (1962) found the ITEA. theoretically sound in examining reading 
disability. Graubard (1965) examined psycho linguistic correlates of 
reading disability in disturbed delinquents, using a reading ncdel based 
on the ITEA.. The model was effective in differentiating correlates of 
reading disability within the group and also was effective in showing 
discrepancies of this group from normal expectancy. It is for this 
reason that this model and test battery were used. 

Kass (1962) has suggested extending the communication model 
at the automatic-sequential level. The following extensions to the 
model were added: 

Auditory: Auditory Discrimination (Wepman, 1958) 
Perceptual/motor: Bender gestalt 

Birch, Belmont Intersensory 

Integration Test ( 1964 ) 
Extension testing: (Silver and Hagin, i960) 

The extension testing was dropped from the analysis when the 
inter-judge reliability coefficient was found to be too low to use this 
test in a psychometric analysis. 



Figure 1 



Clinical Model of Reading 
From Eass (1962) 
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Results 



Folio-wing Cohen* c procedure for Q-analysis Ss v:ere divided 
into 7 groups on the original 4 R factors — conduct problem, personality 
■problem, inadequate -immaturity, and socialized delinquency. Factor loadings 
for the 7 groups on the 4 R factors are shorn in Figure 2. 



Figure 2 
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In order to ascertain -whether there -were real differences on 
the factors among the 7 groups the data were subjected to an analysis 
of variance. The results are shown in Table 2. 



Table 2 



Analysis of Variance between Q Groups on R Factors 



R factor F 

** 

11. Conduct Problem 12.659** 

2. Personality Problem 5*728** 

3* Inadequate -Immature 4.722 n ^ s ^ 

4. Socialized Delinquency 1*579 



df 6,100 



F = 2.19 @ 05 ^ 
2.99 @ *01 



Thus the seven groups differ significantly on conduct, 
personality, and immaturity. They do not differ on socialized delinquency. 



The fact that socialized delinquency did not emerge as a separate 
factor can be interpreted an artifact of observing primarily in 
school situations, since the defining characteristics e.g. , belonging 
to a gang, stealing in a group, etc., are not readily observable in a 
school setting and can be more readily ascertained from case history data 
and parent reports (Quay, 1964). 

The Scheffe Multiple Range Test (1959) was then used to assess 
the differences between groups on the 3 R factors which did differentiate 
the groups (Figure 3). Beacause of the stringency of the Scheffe, the 
.10 level of significance was used, as is the recommended practice 
(Hays, 1963). 



The following graph (Figure 3) illustrates the points at which 
statistically significant differences "between groups emerged. Scheffe results 
are indicated at the bottom of the figure. Table 3 summarizes findings based 



on the Scheffe analyses, which show significant and non-significant effects 
between groups on the 3 remaining E factors. 
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f*0 Table 3 

Comparisons between the Seven Groups and Significance of 
Differences on 3 H Factors: 



Conduct Problem (CP) 3 Personality Problem (?P), and Inadequate -Immature (l.I.) 











C.P. 


P.P. 


• 

H 

• 

H 


7 - 


different from 


6 
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Yes 


Yes 


Yes 


7 - 


11 


n 


5 


No 


No 


No 


7 - 


11 


ii 


4 


Yes 


126 


No 


7 - 


11 


il 
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326 


Yes 


No 


7 - 


:i 


ii 
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Yes 


No 


No 


7 - 


ii 


it 
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Yes 


Yes 


No 
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Yes 


Yes 
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No 


No 
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11 


11 
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No 
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11 
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Yes 


No 


No 


6 - 


11 


11 
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Yes 


No 


No 
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Yes 
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11 


11 
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Yes 
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11 
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Yes 
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11 
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No 


No 
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11 
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No 
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1 
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No 
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* "Yes 51 indicates the difference between the group is significant at 
beyond the .10 level. 
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Description of the Seven Groups . 

Groups 1 and 4 (Figure 3) present a rather similar pattern in 
that they showed high scores on the conduct problem dimension, are close 
'khe mean for the sample on the personality problem dimension, and are 
in the low range, albeit in different directions, on the inadequate - 
immature factor. In fact, when the Scheffe Test is used they do not 
differ on any dimension. Thus, unless discrepancies emerge between the 
two groups on the prediction from factors to criteria variables, the 
Q -analysis method might be too refined in such cases and Groups 1 and 4 
be treated under a si n gle heading. Quay 1 s term of conduct disorder 
seems appropriate for these groups since different patterns do not emerge 
between the -groups. However, .since two groups did appear in Q -analysis, - 
we may for the moment refer conveniently to Group 1 as Conduct -Disorder I, 
and Group 4 as Conduct -Disorder II. 

Group 2 has a unique patterning in that it shows, low scores -on - 
each dimension; it seems to display a mixture of .behaviors without dis- 
playing extreme or even moderately high scores on any one dimension. 

Group 2 will be referred to as a Mixed Symptom Group'. 

Group 3 also appears to be a unique group. It is different from 
some other groups (e.g. 1 and 4) on the conduct problem dimen sion, 
different from 6 and 7 on the personality problem dimension, and shows - - 
the most extreme score of any group on the inadequate -immature dimension. 
Group 3 will be characterized as the Inadequate -Immature Group. 
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Group 3 is also a unique group in that it is just about 
at the mean for all S*> on the conduct problem dimension but shows ex- 
treme lows on the personality problem and inadequate -immature dimensions* 
While Ss for this study were selected on the basis of their presumed 
problem behavior, this group** behavior according to this checklist showed 
the least amount of problems* In view of the plot yielded by Group 3 
on the 3 R factors it may be characterized for the present as Inverse 
Personality Problem - Inadequate -Immature* 

* 

Groups 7 and 6 do not differ from each other but do differ 
from other groups on a number of the dimensions. For example. Group 7 
shows an extremely low score, the lowest score for any group on the 
conduct problem dimension &nd differs fti gn ^fiea n t^ y from Group 1, 2, 4 
and 3 on this dimension* Group 7 then shows the highest score of any 
group on the personality problem dimension and differs from Group 1, 3> 
and 3 * Seven also has a relatively high score on the inadequate HUsnature 
dimension, being only lower than Group 3 on the dimension and ai gnifjeaptiy 
different than 5 (Groups 7 and 5 differ on each of the 3 R factors) . 

Group 7 -Shows extreme variability among the problem dimensions and can be 
labelled as a Personality Problem Group with overtones of Inadequate - 
Xnmature (P*P. - Sub, 1,1*), Six, on the other hand, follows the same 
type of profile but shows less extreme deviation from the mean and can 
be labelled as more of a Personality Problem - Mixed type. 

Groupings as Predictors 



The prel imin a r y part of the analysis showed that the check- 



\ 




list and Q -technique would differentiate among groups of youngsters 



presenting school problems. The next step in the analysis was to de- 
terming; if the seven groups could also be meaningfully differentiated 
amongst themselves on the basis of academic characteristics such as 
reading, whether these groups differed from normals, and whether 
academic and/or intellectual retardation, if any, was more pronounced 
in some groups than others. 

To simplify data analysis and interpretation all grade scores 
and mental age scores were converted to age -score equivalents using 
the norms of the California Reading and Intelligence Tests. This con- 
version was affected through the use of Table 19 in the manual for the 
California Reading Tests entitled "Actual Grade Placements and Cor- 
responding Grade Chronological Ages for Determining Intellectual Status 
Index." This table gives the average chronological age for a child in 
a certain grade level, which is calibrated in divisions of a tenth of a 
grade. 



The WISC Mazes (194-9) has a table for converting scores into 
chronological age. For the Bender-Gestalt Test, Table 6 of the Koppitz 
Manual (1964-) that contained developmental normative data was used. This 
was interpolated where needed, and extended at the beginning and ends 
of the scale. Since no norms have been published for the Intersensory 

*r 

Integration Test developed by Birch and Belmont (1964) the data from a 
directly relevant publication (Birch and Belmont, 1965 ) were used to 
obtain approximate age norms. The expectancy level was cut down by 
since the average IQ, in his population was 4oJ above the traditional IQ 
average o Here also, extensions and interpolations were performed by the 
straightline method. 
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For the Benton Test of Visual Retention (1955) > the table 
from the Ifanual 'was used to get chronological age scores and the 
theoretical expectancy on the test of visual retention. 

It is apparent that the age scores obtained for the Birch 
Intersensory Integration Test, the Bender -Gestalt, and the Benton 
Visual Retention Test are only approximations; they are probably 
quite inadequate, but they were the best obtainable. language age 
scores on the ITBft. were taken from the test manual ( 1961 ) • 



o 







o 
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Table 4 gives group means, and F values are given for the 
in d ic ated variables converted to age equivalencies, and Scheffe re- 
sults -where appropriate. 



Table 4 



Table of Differences Among Groups on Academic 
and Intellectual Variabless 

Mean F Scheffe 

PFVT MA. 



1 

2 

3 

4 

5 

6 

7 



107.71 5.86 7 > 6,2 

92.43 
97.64 

103.90 

117.91 
95.33 

121.36 



Spache, 'Word Recognition 



1 

2 

3 

4 

5 

6 

7 



106.30 

92.81 

106.64 

106.00 
120.54 
104.60 

118.00 



3.20 



5,7>2 



Spache, Language Comp. 



1 

2 

3 

4 

5 

6 

7 



116.77 

108.62 

112.21 

117.50 

121.45 

112.53 

119.18 



/- * 
1.61 



*not significant 

+ df = 6,100; F for £ = .05 is 2.19, aad for £ ■- .01 is 2.99 # 



c 
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hU 



IERJC 



H. 




X 




Calif, Ment. Maturity 


Total IQ 


I** 




105.93 


’2. 




86.37 


3. 




93*69 


4. 




95.64 


5. 


* 


103.80 


6. 


. 


90.60 


7- 


Calif. Lang. IQ. 


113.18 


1. 




107.93 


2. 




88.81 


3. 




94.92 


4. 




93.68 


5. 




102.70 


6# 




89.20 


7. 


; 


114.00 




Calif, Non-Lang, IQ. 




1. 




108.14 



2, 

3. 

4 . 

5 # 

6. 

7 . 



1. 

2, 

3. 

4. 

5. 

6 . 

7. 



89.68 

98.46 

100,27 

108.80 

99.53 

115*27 



Calif* Numerical Beas* 



51.71 

34,68 

38.57 

43,81 

41.09 

37.33 

39.90 



3.49 



7 }6 



2.78 



7 >2.6 



3.03 



7.5 >2 



2.82 



1/5, 7,3 ,6,2 



■ 



fir, 

i-i 
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Chro no logical Age 

1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

Calif. Read. Voc. 



x 



115.93 

113.92 

114.35 

112.86 

129.45 

127.33 

121.09 



F 



Scheffe 



. * 
2.04 



not significant 



1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 



101.00 

89.00 

ioo.i4 

93.14 

114.70 

101.80 

115.10 



3.97 7,5 >2 



Calif. Read. Compr. 



1 . 

2 . 

3. 

4. 

5. 

6 . 
7. 



97.25 

84.12 

96.85 5.53 7,5 2 

89.82 
110.72 
99.20 
107.90 



Calif* Tot. Read. 



1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 



100.00 

87.44 

99.29 

94.22 

110.72 

100.60 

112.45 



4.14 7,5 > 2 
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To e xa m ine the question of whether disturbed Ss were re- 
tarded in reading the M (PEVT) converted to language age was used 
as an expectancy level. Beading retardation was operationally defined 
as Mental Age minus Beading Age (Harris, 1964) and the California 
Beading Test Total Age mbs compared with this expectancy. 
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Table 5 



Comparison of Groups on Mental Age vs. Reading Age 



Q group N 

1 14 

2 16 

3 15 

k 22 

5 11 

6 15 

7 11 



<1 

<1 

<1 

2.425 

<1 

6.20. RA^MA @ .01 level 

< X 



The above table demonstrates that these behaviorally disordered, 
were not in fact retarded in reading when Mental Age was tak en into 
account. When CA and MA were compared the following results were uncovered: 



Table 6 



Comparison of Groups on Chronological Age vs. Mental Age 



CA. vs. MA 



Q, group 



F 



P 



1 

2 

3 

k 

5 

6 

7 




1.8l 

1.23 

19.39 





The analysis of variance for MA (Mental Age) vs. Reading Age 

is shown in Table 5. 






o 
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To answer the question of whether Ss were retarded in 
reading relative to CA the data were analyzed to see if GA. was greater 
than RA. The following results were obtained: 

Table 7 

Comparison of Groups on Chronological Age vs, Reading Age 



Group 


F 


p 


1 


6.12 


.05 


2 


7.73 


.05 


3 


4.08 


N.S. 


4 


21.10 


.01 


5 


4.0.5 


N.S. 


6 


10.98 


.01 


7 


1.15 


N.S. 



Thus it can be seen that the Groups 3, 5, and 7 were reading 
at a level commensurate with their o'lrono logical age. Group 5 and 7 
also scored highest on most of the intellectual and achievement tests. 

In addition, it was apparent that each group was achieving at least com- 
mensurate with its mental age or expectancy while one group, Q6, or 
Personality «• Problem, Mixed Type, could be defined as overachieving. It 
appears that given a normal IQ, the higher the score on the conduct dis- 
order dimension the more retarded is reading relative to chronological 





age. 
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Since expectancy can “be defined in a number of ways and 
other researchers might wish to analyze the data differently Appendix B 
is included to show different means and how the different groups re- 
lated to ITEA. Language Mean, California Verbal and Son-Verbal IQ, etc. 

The complete test data were also analyzed by a treatment by 
subjects design (Lindquist, 1953 > p. 156 ) in order to eliminate inter- 
subject differences as a source of error. PPVT MA. was used as a mean 
of 0 and a matrix ms composed which showed deviations from the baseline 
on the variables of the ITPA and reading tests. The list of variables 
are shown in Table 8. 



( 



Table 8 

Table of Symbols for Tester Used in Treatment by Subjects Analysis 



1 2 

Auditory- Visual 

Vocal Decoding 

Automatic (ITEA.) 

(ITEA.) V.D. 

A.V. Auto 



3 

Motor 

Encoding 

(ITPA) 

M.E. 



4 

Auditory 
Vocal Assn. 
L -V. Assoc. 



5 

Visual 

tfotor 

Seq. 

(ITBA.) 

V.M.S. 



6 7 
Vocal Aud. 
Encoding Vocal 
(ITPA) Seq. (ITEA.) 
V.E. A.V. Seq. 



8 9 10 11 12 13 

Visual Aud. Spache Spache Calif. Calif. Calif 

Motor Decoding Word Listening Beading Reading Reading 

Assn. (ITEA.) (ITEA.) Recognition Compr. Test Vocal Test Compr. Test Total ; 

V.M. Assoc. A.D. (S.W.R.) ■ (S.L.C.) ‘ C«R,V c C.R.C. C.R.T. ; 






Following the analysis of variance the Tukey test (Edwards, i960) 
was used to study which differences between tests were significant. The 



following tables show these analyses: 



fable 9 

Treatment by Subjects Analysis of Within-Group Achievement 
for Q1 on ITEA. and Reading Variables 



01 ( N= 9) 



2 



Source 


H 


* * 


s 


S 


”8 


95068 


11883.50 


A 


13 


11567 


889.76 


AXS 


104 


32937 


316.70 


T 


125 


139572 





F 

37.6 



The Tukey at the .05 yielded the following data: 



S.L.C. 


S.V7.R. 


A.D. 


V.E. 


M.E. 


A.V.Seq. 


C.R.V. 


9.55 


4.22 


-4.88 


"5.33 


-8 


-9.44 


-9.77 


C.R.T. 


A.V .Auto. 


C.R.C. 


V.M.Assoc. 


V.D. 


A,. V. Assoc. 


V.M.S. 


-10.33 


-10.66 


-12.11 • 


-33.11 


14.11 


: -15.33 


-31.22 



t= 17.49 for a significant gap and it was discovered that there were 
significant differences between scores on the Spache Listening Comprehension 
and other variables and Spache Word Recognition and other variables. 

L.C.>M.E., A.V.Seq. , C.R.V., C.R.T., A.V.Auto, C.R.C., V.A.Assoc., U.D. ,A.V .Assoc. 
V.M.Seq., W.R.>V.D., A.V. Assoc., V.M.S. 

Table 10 



Treatment by Subjects Analysis of Within-Group Achievement 
for Q2 on ITPA and Reading Variables 



02 ( N=8) 



Source 

A 

S 

AXS 

T 




1 ? 

(a-l) 

(s-1) 

(a-l) (s-1) 
W-as 


df 

33 

7 

91 

111 


__2 
s. ^ 

U.T 938 

24,651 

18,940 

55,529 


MS 

918 

3522 

208 


F 

44l 


M.E. 


S.L.C. 


S.W.R. 


V.M.Assoc. . 


V.D. 


C.R.C. 


V.M.Assoc. 


15.13 


13.25 


1.50 


1.12 


.62 


-5.37 : 


- 5.38 


C.R.T. 


C »R«C # 


V.E. 


A.V. Assoc* 


A.V.Seq. 


A.V.Auto.| 


V.M.S. 


-6.87 


- 8.75 


-9 


-11.62 


-12.38 


-16 ~ 


-24.75 



With t. 05 a significant gap -was 14.20 and the Tukey yielded the 
following data: 

M.E.} V.D., C.R.V., V.M.Assoe. ,C.R.T. ,V.E. , A.V .Assoc., A.V.Seq., A.V .Auto, V.M.S. 
S.L.C.^ C.R.V., V.M.Assoc., C.R.C., V.E., A.V .Assoc., A.V. Seq., A.V. Auto, V.M.S. 
S.W.R.^ A.V .Auto, V.M.S. 



Table 11 



Treatment by Subjects Analysis of Within-Group Achievement 
from Q3 on ITPA and Reading Variables 



Source 


df 


x/ 2 


S 


F 




A 


13 


l8,4l6 


1417 


15.40 




S 


.7 


49,689 


7098 






AS 


91 


8,342 


92 






Total 


111 


7^,447 










With t .05 equalling 9.46 for a significant gap 


the 






Tukey yielded the following data 


* 






N = 8 












S .L.C. 


S.W.R. A.D. 


C.R.V. 


C.R.T. 


C #R • C • 


V.M.Assoc. 


12.12 


5.37 -1.87 


-2.62 


-3.75 


-7.37 


-9.0 


M.E. 


V.D. A.V.Seq. 


A.V .Assoc. 


A.V .Auto 


V.E. 


V.M.S. 


-10.25 


-11.0 -12.12 


-14.62 


-23.75 


-24.5 


-41.37 



S.L.C.^A.D., C.R.V., C.R.T., C.R.C., V.M.Assoc., M.E., V.D., A.V.Assoc. ,A.V,Auto, 
V.E., V.M.S. 

S.W.R./ G.R.C., V.M*Assoc. , M.3., V.D., A.V.Seq., A.V.Assoc., A.V.Auto, V.E., V.M.S. 
D.E. K, A.V.Seq. , V.D., M.E., V.M.Assoc., G.R.C., C.R.T., C.R.V., A.D., S.W.R., S.Xi.C. 

X 

V.M.S. < All 

A.V*Auto ^ A.V. Seq., V.M. Assoc., A.D., S.W.R., S.L.C., C.R.V., C.R.C., C.R.T. 
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j Table 12 

Treatment by Subjects Analysis of Within-Group Achievement 
for Q4 on ITPA and Reading Variables 



Source 




df 




SS 


MS 


F 


A 




13 




15,210 


1170 




S 




12 




42,329 


3527 


5.H 


AS 




156 




35,663 


229 




TOTAL 




209 




93,202 




- 






H = 33 










S.L.C. 


V.D. S.W.R. 


M.E. 


A.D. V,M.Assoc. 


C.R.V. : 


16.75 


9.15 4.83 


4.6l 


.69 


-3.46 




-3.58 

i 


A.V.Seq. . 


C.R.T. V.E. 


A.V .Assoc. 


C.R, 


,C. A.V .Auto 


v.m.s. : 


-4.0 


-4.75 -7.0 


- 7.69 


- 8.75 - 12.53 




- 22.92 


•L.C., S.W.R. 


, M.E., A.D., V.M.Assoc., C.R.V. 


, A.V.Seq., C.R.T. 


, V.E 


• , A.V .Assoc 



C.R.C., A.V. Auto, V.M.S. 

V.D.^V.M. Assoc., C.R.C., A.V.Seq., C.P.T., V.E., A.V.Assoc., C.R.C. ,A.V.Auto, V.M.S. 
S.W.R.} V.E., A.V. Assoc., A.V .Auto, V.MLS. 



Table 13 

Treatment by Subjects Analysis of Within-Group Achievement 
for Q.5 on ITPA and Reading Variables 



Source 


df 


>~ i 2 


Ms 


A 


13 


12,688 


976 } 


•s 


6 


66,816 


11,136 


AS 


78 


lo,64i 


136 



M- 

l 



ERiC 



TOTAL 



97 



90 ,3.45 



1^.1^ "'fitusii* 
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A t of 12.35 was needed to achieve a significant gap between 
groups. Hie Tukey yielded the following data: 



N = 7 



S.W.R. 


S.L.C. 


C.R.V. 


C.R.C. 


M.E. V.E. 


C.R.T. 


+ 9.43 


+ 1.00 


+ .71 


-4.86 


-7.14 -9.57 


-13. 


A.D. 


V.M*Assoc. 


V.D. 


A.V .Assoc. 


A.V .Auto. V.M£. 


A.V. Seq.. 


-15.14 


-16.28 


-17.42 


-20 


-22 


-29.57 


S.W.R.> 


C#R#C« ^ M # E# j 


C.R.T., 


A.D., V.MJlssoc., V.D., A.V. Assoc., A.V.Auto 



V.M. Seq.., A.V. Seq. 

S«L.C.> A.D., V.M. Assoc., A.V. Assoc., A.V. Auto, V.M.S. V.D. 
C.R.V.>A.D., V.M. Assoc., A.V. Assoc., A.V. Auto, V.M.S. 

V.M.S.} V.E., M.E., C.R.C., C.R.V., S.L.C., S.\.R. 

Table l4 

Treatment by Subjects Analysis of Within -Group Achievement 
for Q6 on ITEA and Reading Variables 



Source 


df 


SS 


MS 


F 


A 


03 


10,101 


777 




S 


7 


42,182 


6026 




AxS 


91 


24,286 


267 


2.91 



TOTAL m ~ 76.569 



j 1 ' * j m v. ! F 1 v • -v ' ’ ' ^ i », w ■' rv :■ v » '. ■ .■ rr r r ' M J IV ' LJ P U J U ' ' 1 ' I « ' l '.If J 
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A t of 16.10 was needed to achieve a significant gap between 
means on the Tukey. 

The following data were yielded: 



S.L.C. 


C.R.T. 


S.W.R. 


V.D. 


C.R.V. 


C.R.C. /.M.Assoc. 


14.50 


8.37 


8 


6.87 


5.37 


2.75 2.37 


A.D. & M.E. 


A.V. Seq. 


V.M.S* 


A.V .Assoc. 


V.E. 


.A.V. Auto 


1.0 


-8 


-8.37 


-10.57 


-12.62 


. -20.62 



S.L.C.N A.V. Seq., V.M.S., A.V. Assoc., V.E., A.V. Auto. 
C.R.T.NA.V. Seq., V.M.S., A.V. Assoc., V.E., A.V. Auto. 
S.W.R.^ V.M.S. , A.V. Assoc., V.E., A.V. Auto. 

V.D.> A.V. Assoc., V.E., A.V. Auto. 

C.R.V.^ A.V. Assoc., V.E., A.V. Auto. 

C.R.C.^ A.V. Auto. 

V.M. Assoc . K A.V. Auto. 

/ 

A.D. y A.V. Assoc. 

Table 15 



Treatment by Subjects Analysis of Within-Group Achievement 
for Q7 on ITEA. and Reading Variables 



Source 


df 


ss 


; MS 


A 


33 


376 


! 28.92 
1 


S 


7 


44,167 


1 

I 

1 


AxS 


91 


4,355 


47.86 


T 


ill 


48,898 


j 



^ERLC 



r 
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The aliove results show that except for Group 7, a group 
that was achieving commensurate with its age and mental expectancies, 
each group showed significant within-group discrepancies between aspects 
of language — reading and ITPA subtests. 

The previous analyses were essentially concerned with 
grouping, achievement, and within-group differences. This investigation 
was also concerned about comparing the different subgroups of the popu- 
lation under investigation between themselves and, further, to discover 
if and how each group differed from theoretical expectancy. 

A proportionate number of Ss from each of the seven groups 
was individually tested by a trained examiner on a psychological battery 
of tests. The probability value of .05 (two-tailed) was set as the 
significance level between groups. 
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The following table shows the means, F values, and t tests 
where appropriate for the battery of tests between groups, and com- 
prised the reading model* 



Table 16 



Analysis of Variance between Q Groups 


on Theoretical 


I4> del of Reading 






N =65 


ITPA Auditory Vocal Automatic 


F 


P 


1.30 




ITPA Visual Decoding 


.82 




ITPA Motor Encoding 


1 . 025 ^ 




ITPA Auditory-Vocal Association 


3.02 “ 


. 0 ] 


ITPA Visual-Motor Sequencing 


1.95 


ITPA Vocal Encoding 


1.07 




ITPA Auditory-Vo cal Sequencing 


.403 




ITPA Visual-Motor Sequencing 


. 776 




ITPA Auditory Decoding 


.296 




ITPA Total 


1.086 




Monroe 


.407 




Kass Visual Closure 


1.183 




Birch 


1.93 




Wepman X 


1.05 




Wepman Y 


.076 




Benton Correct 


.358 




Benton Error 


.635 

.624 




Mazes 


.507 





t 

7j5> 2 



These groups were differentiated only on the basis of the Auditory-Vocal 
Association Tests. 

The next step in the data analysis was to compare each group's 
actual achievementjdth its expected achievement on the ITPA model. Following 
Kass' design, z = x - was used and the probability value for each z was 
noted. It had originally been planned to assess the expectancy of tests like 
the Kass, Bender, Birch and Benton, but since those norms are used privily 
for guidelines and those tests are not yet fully standardized it was decided 
that any results could well be spurious and an artifact of methodology rather 
than real strengths or weaknesses within the group. The Silver and Hagin 
Extension Test and the Harris Test of laterality were dropped from the battery 
because the reliability between judges was so low that youngsters could not 
be meaningfully categorized. The Kfanroe Test was also dropped when it was 

found that one of the examiners systematically introduced a bias in the test 
by spacing the vowels too far apart. 

The following table shows the probability level for the z scores 
for each of the ITPA subtests and the raw scores of the Mazes Scaled Score WISC. 



Table 1 



rj 



Probability tevels for Z Scores of Q Groups Indicating Strengths 
and Weaknesses on Reading Model S 

Strengths Weaknesses 



M.E. 



01 

02 .07 

03 

04 

05 .09 

06 

07 .07 



V.E. 



V.M.S. 



.001 




The results demonstrate that the relative strengths of this group com- 
pared to normals are in the encoding areas. Strengths must be interpreted with 
caution since some of the Ss used in this study were above the age level for the 
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norms of the test. 

While the ITEft. limits only go up to 9 this test can he used 
according to the manual to uncover deficits in older children, so that 
•with ot; Ss relative strength may not he uncovered hut deficits are. 
In addition, the test also correlates positively with social class. 
Perhaps the low social class of Ss worked to prevent Ss from going over 
the ce iling cn this test. Previous research (Grauhard 1965) found that 
low SES emo tionally handicapped Ss who were above the CA of the test 
ceiling did not, except in isolated suhtests, go above the nerm of the 

rrm. 



An obvious area of weakness for almost the entire sample was 
Vis ual Motor Sequencing and Auditory-Vocal Automatic. Certain groups 
had difficulty with the Auditory-Vocal Association (it appears that 
these groups were also inferior in 3ft to other groups) and Mazes. Two 
of the three groups that had difficulty in this latter area also scored 
highest on the conduct disorder dimension of the checklist. 

Tn summary, Ss were sorted into ft groups* Each ft group was 
measured on a number of variables. The analysis of variance was used 
to assess differences between groups. Consistent differences emerged 
showing Groups 7 and 5 to he superior to Group 2 and often to Group 6. 
Differences between other groups were not significant. On a model of 
reading there were virtually no significant differences between groups. 
When compared to normals, relative strengths emerged in the Encoding 
Area and deficits appeared in the area of Auditory-Vo cal Automatic, 
and Visual-Motor Sequencing. 




DISCUSSION 



Ibis investigation was concerned with examining the efficacy 
of the Behavior Problem Checklist ascertaining whether disturbed Ss 
are retarded in reading relative to CA and MA and whether there were 
differences between subgroups of disturbed Ss_ and between disturbed 
Ss and normals on such variables as reading level, IQ, and other psycho- 
metric characteristics. 

From the data it appears that there are meaningful clusters 
within the term "emotionally disturbed” and that there are some edu- 
cationally relevant variables associated with behavior clusters. 

For example: 

One group, Q6, or the Personality Problem-Mixed Type, is in 
fact an overachieving group relative to Mental Age. This group was ex- 
tremely low on the dimension of aggression, and rather "pure" as to 
characteristics such as "aloofness," "shyness," "self-consciousness," 
"easily flustered," and "confused." It appears that this group is very 
eager to please their teachers, and to avoid ridicule or "being ho ll ered 
at." It appears that they are quite "successful" academically, although 
it must be remembered that Group 6 has an MA significantly lower than 
its CA. 

As another example. Groups 5 and 7 are generally functioning 
well vis - 4 -vis reading achievement. Group 5 is not above the mean on 
any dimension. Interestingly Group 7 has the highest score on personality 
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problems, and a very high score on the inadequate-immaturity dimension, 
but the lowest score of all groups on the aggressive dimension. 'While 
several groups have lower scores than Q7 on personality problems and 
inadequacy-immaturity it appears that when their scores are coupled 
with scores above the mean on aggression, the group does relatively 
less well on IQ and/or reading tasks. Thus, there appears to be an in- 
verse relationship between aggressive behavior or conduct disorders and 
academic achievement. 

Not only are there academically relevant behaviors associated 
with Q groups but meaningful differences also emerged between some groups. 
Thus Groups 5 and 7 are often superior to Group 2 and 6. Group 6 in fact 
could be considered a retarded group, although none of the Ete were in 
special classes for retarded children. Sis in Q6 were considered quite 
disturbed by their teachers but their highest z score was in the dimension 
of personality problem with traits like "anxiety," "chronic general fear- 
fulness," "depression," and "chronic sadness" checked off. It appears 
as if this group was working as well as, if not better than, one would 
expect, but these Ss are now in competitive situations and such situ- 
ations my well exacerbate traits like "fearfulness" and "depression." 

Group 2, on the other hand, was composed of young Ss not 
quite as differentiated or "pure" as in Q6. It was a group with re- 
latively low IQs (M=86.38, SD=11.24), and mostly consisted of special-class 
day school pupils. This group did not show an extreme score on any dimension 



■but rather showed an assortment of many traits, some of them almost con- 
tradictory, so that they scored above the mean for all Ss^ on "both 
aggressive and personality problems and very close to the mean in im- 
maturity. This was in sharp contrast to the groups (5 and 7) which were 
superior to them, in that 5 and 7 were more consistent in their behavior. 
Groups 2 and 6 differ both from each other and from Groups 5 and 7« 

(Group 2 seemed to be lowest on many scores even though their IQ was 
higher than that of Q6. The fact that 2 was higher on aggression than 
6 seems to account for this difference.) 

Certain "learning" patterns did emerge within groups for se- 
lected groups. Thus, the treatment by subjects analysis demonstrated 
differences between groups for the acquisition of ITEft., reading and 
IQ skills. Miile all groups might eventually pick up the same skills, 
perhaps they acquire skills in a different order. Thus, the sequencing 
for teaching skills to some of the groups could be different. The data 
from this study certainly point to that possibility. Moreover , within 
certain important limits (such as heterogeneity for the sake of seeing 
different behavior modelled) , specialized curricula could be developed 
for each group. As an. example. Group 7 showed a deficit only in Visual 
loo tor Sequencing. Quay et al (1966) and Hewett (1967) demonstrated that 
it is possible to condition visual orientation. vJhile Group 7 did not 
appear to have a particular memory deficit as evidenced by IQ and achieve- 
ment scores, they do show a problem in attentiveness. A curriculum can 
be directly geared to this deficit. 
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As another ^6 appears to he decidedly deficient in 

j±! 4 Auditory Vocal Automatic, Auditory Vocal Association, and Auditory 

Vocal Sequencing as well as in planning ability as evidenced by the 

% 

Wise Mazes. In short, this group was greatly deficient in verbal 
skills and a large number of Ss could be classified as retarded. Thus, 
curricula for the group should develop the verbal abilities of the 
group and enable these Ss to express themselves in a more appropriate 
\ manner. 





0,2 also pres ent s a distinct pattern in that Motor Encod in g 
was their hipest strength area and their 3Q was quite low, as were Visual 
Motor Sequencing and Auditory Vocal Automatic* It appears as if the 
group can take in verbal communication, an^L curnc ^ 
on the develojment of the Sequencing area and Auditory Vocal Automatic. 

Qi an a ggr essive group, also showed weaknesses in areas that 
called for delay of impulses and for visual and motor attention to detail. 

t his group, too, could benefit from the conditioning procedures de- 
veloped by Quay and Hewett. 

On the other hand, the differences between groups, while apparent, 
were not str iking . After the differences in achievement were uncovered 
between groups the next step in the analysis was to examine the data 
between the groups to see if there were any differences on psycho- - 
logical tests which presumably influence §£ in their manner of acqu ir i n g 
symbolic knowledge as well as in terms of ability. Analyses of variance on 
various meas ures showed significant differences for only one test, the Auditory 
Vocal Association subtest of the ITHA., where Groups 5 and 7 were superior 
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to Group 2. However, the correlation between this test and bA have been 
found to be so high (Kirk and McCarthy, 1961) that differences between 
these groups can be attributed to I>5A. alone. 

In summary, it appears that the groups do differ to some extent 
with respect to IQ and associated factors, but there are no other dif- 
ferences between groups in terms of psychometric characteristics. Dif- 
ferences in IQ that emerged seem to indicate that Ss who show aggressive 
coupled with personality problem traits perform poorly (Group 2) , as do 
low IQ children (Group 6). 

Therefore, with regard to psychometric characteristics one would 
conclude that disturbed children are essentially not delineable in terms 
of the traits assessed by the Quay checklist, with the exception of some 
IQ differences . This does not imply homogeneity of disturbed children 
across such characteristics; rather the children are quite variable with 
respect to these measures and such variability is shared from group to 
group. 



Using the Quay scale and Cohen's Q -analysis it appears as if the 
more aggressive c h i ld ren were retarded in reading relative to chronological 
age. However, no groups were retarded in reading relative to mental age. 
Groups 1 and 4 follow the same general pattern except that Group 4 seems 
to display a good deal of immaturity as well as aggression whereas Group 1 
appears to display more of an aggressive delinquent pattern. Interestingly, 
Group 1 was significantly higher on Numerical Reasoning than any other 
group except Group 4, its behavioral "peer". 



L 
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The data shoving that differences between groupa-vere. minimal 
also answer, in part at least, the question of how great the consonance 
is between behavioral characteristics (e.g. boisterousness, aloofness) 
and learning characteristics (e.g. TSSk profile). The similarity between 
groups argues against grossly differential curricula, although, again, 
the sequencing might be different for different groups* Further, it 
appears from the data of this study that because of the mininal dif- 
ferences between groups, the overlap between behavioral characteristics 
and lear ning characteristics is not great. Differences are reflected 
primarily in gross areas like IQ, and reading rather than in terms of 
possibly more refined factors which could influence learning. 

When compared with normals, however, the disturbed groups 
showed distinctive differences (See Table 7 and 17 and Appendix B). When the 
data cn different groups were examined for inter-group differences and 
for deficits in different areas relative to normals, great heterogeneity ap- 
peared between the disturbed groups, except in two areas. In Visual Motor 
Sequencing (VMS) and Auditory Vocal Automatic.. (AKA) the disturbed groups 
were quite homogeneous in deficits, and were in striking contrast ±0 the 
normative group. The VMS test purports to measure attention to task and 
visual memory and perception, while AVA is ostensibly a grammar completion 
and closure task which measures overlearned material. 

It is not clear to this writer just why these tests discriminated 
these disturbed jSte so clearly and cut across IQ, reading levels, and types 
of behavior* Graubard (1965) had found that aggressive children showed 
this type of learning deficit and related it to a distorted time sense and 
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lack of im pulse control, but it -was not hypothesized that Inadequate - 
Immature and Personality Problem Ss “would also show this kind of 
learning pattern. It will be interesting to see if these findings 
are repeated in other studies with the less aggressive children. 

As was stated before, most of the groups had difficulty with 
the Auditory Vocal Automatic ITIA subtest and this investigator was 
particularly concerned with the fact that many Ss did poorest on this 
test. The significance of this test should not be overlooked, for it 
had the highest correlation with reading. This correlation is shown 
in Table 13. 



Table 18 

Pearson product moment correlation between Auditory 
Vocal Automatic (ITiA) and Reading Measures. 

N=54 

Spache WJR. Spache L.C. Cal. Read. V. Cal. R. Comp . 

(761) (.01) (.01) (.01) 

• i 

Auditory- 1 

Vocal .8040 .4965 I .6936 : .6430 

Automatic j ’ 1 

In addition Deutsch (1964) has observed that students become 
aware of poor grammar and syntax and their language then becomes intra- 
class contained. Moreover , Bernstein (1962) has uncovered a great deal 
of evidence that difficulties with syntax and the structure of language 
turn those with these difficulties to the use of a "restricted code," 
and its users then focus on interpersonal communication rather than more 
cognitive means of communication. 
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When compared with normals in academic achievement- p»r sc dis- 
turbed Ss did show retardation in certain areas and not in others* Only 
Groups 1 add 4 were retarded in reading relative to CA, and no group was 
retarded in reading relative to M&. Thus, most Ss were not retarded in 
reading. This finding is significant because of the widespread belief 
that disturbed S£ are generally quite retarded in reading. 

For example: Horse et al (1964) have noted "It is a matter of 
common clinical observation that many such children (disturbed) are 
academically retarded.*' Certainly, prevailing sentiment among clinicians 
and educators is that, as a group, disturbed Ss are retarded in academics* 
ike teacher's perception of Ss surveyed in the Horse study was that 
"academic retardation was an important accompaniment of emotional handicap 
in a majority of the childro^jobserved (1964, p,24)." Morse also stated? 
"Site visitor's observations indicated that remedial efforts in this area 
constituted a large part of the classroom program." 

Since the question of whether disturbed Ste as a group are 
academically retarded seems to be fundamental, the Horse study is worth 
examining closely. Morse used a quotient index te e&alae whether dis- 
turbed Ss were functioning below expectancy and then reported that most 
Ss were. 

2 

The quotient index reported by Horse was subjected to & / 
analysis by this investigator to examine whether the 55^ functioning 
below 100 were significantly greater than the 45 % functioning above 1005& 
or whether this discrepancy could be attributed to chance alone. 
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The / follows: 
N « 154 



WT 



69.3 



Below 



Above 



/ 2 = 1.67 



n.s 



df 



1 



Thus, statistical analysis revealed that no significant difference 



existed between those falling above expectancy and those below, and there 
was no contravening evidence to suggest that disturbed Ss_ as a group do 
not follow the normal curve. 

Implications 

In Morse's study only 21$ of former teachers and 30$ of the current 
teachers felt that Ss were not academically retarded, but in fact 45$ of 
Ss were not retarded according to psychometric data. Statistical analysis 
does not support the statement that academic retardation was a major problem 
for the group. Of great interest and concern to this investigator were 
Morse's conclusions that "What would seem to be a central process in charting 
the child's progress was neglected in these programs. Teachers usually knew 
about the retardation and often felt that specific tests were not necessary 



or might have given misleading information ,;" 





One questions whether the teachers really "knew" or were their 
expectancies obscuring the real picture? Since the child is having be- 
havior problems, it is assumed that he is therefore having all kinds of 
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other problems* It is important that this expectancy set be broken io 
that emotionally disturbed children can be seen as individuals with a 
range of behavior , and with some problems that are circ ums cribed , so 
that difficulty in one area does not necessarily spill over into another* 

As Balow (1966) has stated, the belief in academic retardation 
is prevalent but the evidence is equivocal, and the better designed 
studies seem to indicate that, in fact, emotionally disturbed children 
as a group are not academically retarded if mental age is used as the 
expectancy criterion. 

In one study, the writer (Graubard, 1964) found an institutional- 

* 

ized delinquent -disturbed sample almost three years below expectancy in 
reading where comprehension instead of word recognition was used as the 
criteria; but the sample was a group that had been institutionalized 
for a number of years. That study is open to further criticism on the 
grounds that mental age was used when many of the were above CA 12, 
where mental age is not a very meaningful or useful concept, 

Shimota's (1964) otherwise excellent study is open to the same criticism, 
for only approximately one third of her sample was found to be disabled 
in reading when reading skill was defined as 25 percent or more below 
expectation based on age and IQ. As Balow pointed out, a fundamental 
difficulty in interpretation and comparison is that social class back- 
ground, IQ distribution, and the nature and severity of emotional dis- 
turbance are not spelled out in most of these studies. 
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There is one other large scale study which must also he con- 
sidered. Rahinovitch (1964) examined 500 Ss and concluded that 
approximately two-thirds of the hoys and more than three -fourths of 
the girls were achieving according to expectancy, using the California 
Achievement Test as the criterion. Expectancy or adequate achievement 
was defined as achieving less than one year helow CA for Ss^ 11 and 
younger, 2 years for Ss 11-1 and older. Rahinovitch reported that 
certain groups such as neurotic acting-out and primitive, neglected 
children had the highest percentage of underachievers, hut the re- 
liability of psychiatric diagnosis (especially for children) leaves 
these conclusions open to douht. 

We then see that this study and those hy Morse et al. (1964) 
and Rahinovitch (1964) using the largest Rs_ and the most stringent 
criteria essentia lly demonstrate that emotionally disturbed children as 
a group do not display academic retardation. Perhaps Hohhs (1966), 
Morse (1964) and others have looked at Ss like those in Groups 1 and 4 
(these §£ are certainly quite visible) and generalized from them. 

Thus, the data from the current study showed that, regardless 
of category, disturbed Ss were not in fact significantly retarded in 
reading when mental age was taken into account. Two of the groups were 
reading significantly helow CA, hut CA is not always a sufficient base- 
line or expectancy rate. The withdrawn Ss_ read as well as expected. 
This finding weakens the psychoanalytic argument that reading is an 
"aggressive" act and that many disturbed children do not learn to read 




■because reading is equated -with "peeking" and -withdrawn children are 
afraid of the consequences of actively lear ning . 

It can he argued that 2 >A or expectancy is depressed by disturbance 
and therefore the expectancy is set too low or that reading tests and IQ 
tests test the same skill and therefore the correlation is high s In answer 
to the first argument , mental age is not being used in this study as an 
impenetrable ceiling which cannot be raised; racher it is being looked at 
as an important indicator of verbal skill which is highly related to the 
extent to which verbal comprehension can take place, since reading is not 
a skill in isolation but is part of language (Myklebust and Johnson, 1962) * 
While it might be true that disturbed Ss "true" IQs might be higher, it 
can also be argued that currently it is a realistic although far from perfect 
expectancy rate. Also, the literature does not show real fluctuation in IQ 
after psychotherapy (laVietes et al, 1966) , which weakens the argument that 
there is a "true" IQ which is hidden by emotional disturbance. As to the 
argument that IQ and reading tests measure the same thing, there is some 
experimental evidence (Graubard, 1967) that the particular IQ test used, 
the PFVT, is not as good a predictor of academic success as instruments 
like the WISC or Binet, and Graubard found a nonsignificant correlation 
between the PFVT and a reading measure although children specifically re- 
tarded in reading were used as Ss. Thus it appears that high performance 
on the PFVT does not necessarily mean high performance on a reading measure, 
and the two measures can be independent although in most cases, as one 
would expect, the correlation between IQ and reading is about .60 or .70. 
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In conclusion to the question of whether Ss as a group are re- 
tarded in reading it appears that: 

1) Disturbed Ss as a group are not retarded in reading. 

2) The more aggressive groups are retarded in reading 
relative to CA.. 

3) Even the more aggressive groups are not retarded 
in reading relative to MA.. 

4 ) It must be remembered that there are general deficits 
insofar as reading is adequately predicted by VA de- 
ficits. lie can now say which children are likely to 
show deficits. 

In this study, as in Morse* s, a majority of the teachers inter- 
viewed perceived the Ss to be achieving far below what psychometric in- 
struments showed,, 

Implications of Data 

1 ) The Rosenthal effect - Rosenthal and Jacobson (1968) have 
convincingly demonstrated that teachers can function as Pygraalions , 

They informed selected teachers that randomly assigned children had 
particular characteristics, e.g. gifted, retarded. Teachers were not 
told that matched Ss had the same characteristics. After a while the 
Ss took on the characteristics that had been ascribed to them by the 
teacher, so that the children who were supposed to be bright became 
bright, etc. Thus, they empirically demonstrated that children met the 
expectations, for better or worse, of significant adults. This phenomenon 
has often been clinically observed but never so systematically demonstrated. 
The perception of a teacher vis -a- vis the academic retardation of dis- 
turbed Ss may in fact become a self-fulfilling prophecy and in the long 
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run children might very well meet these subtle expectations. 

2) Establishment of hierarchies for teacher training programs 
in the education of the emotionally disturbed . If emotionally disturbed 
children are not academically retarded as a group, perhaps less emphasis 
can be placed on remedial methods in teacher tra ining programs and mor ; 
emphasis on problems of management and motivation. Of course, this in- 
vestigation is concerned with averages, and it must be remembered that 
many individual Ss did show significant academic retardation requiring 
specifically geared remedial instruction rather than general develop- 
mental reading lessons. This investigator is saying only that in a 
limited training period certain choices and priorities have to be made 
in terms of content covered. Certainly remedial methods are an important 
part of the repertoire of all teachers, but the evidence of this study 
indicates that teachers of the emotionally handicapped will find on the 
average about as much academic retardation for the children they service 
as will regular classroom teachers. If the special education teacher is 
primarily to service academically retarded children^ he must master re- 
medial methods. However, contrary to prevailing opinion, the special 
education teacher, at least for students ages eight through ten, will 
primarily service children who arc not remedial reading cases. Therefore 
teacher education programs need not prepare remedial specialists in this 
area on the assumption that they will primarily service academically 
retarded students. 
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3) Emotional disturbances as the predictor variable . While 
it appears that emotionally disturbed children as a group are not 
achieving below expectancy, there is empirical evidence that a large 
number of disturbed children are functioning below expectancy, and there 
is clinical evidence that many disturbed children have had their emotional 
problems exacerbated by poor achievement in school. All of the in- 
vestigations discussed have been essentially correlative in nature, 
and cause-and-effect inferences from such data are speculative at best. 

As Bateman (196 6) points out in her review: 

"Important questions deal with the efficacy of remedial 
methods and treatment procedures as a function of 
particular disabilities and in the study of the pre- 
dictive value of emotional problems in the development 
of programs to prevent learning problems. While much 
work in the prediction of potential learning problems 
is still in progress and unpublished, no major or 
serious efforts, to the reviewer's knowledge, are under 
way to use emotional disturbance as a predictor variable." 
(Bage 103.) 

The importance of this pus t be underscored, for the develop- 
ment of a science of -pedagogy is dept .ldent upon the ability first to pre- 
dict and then to change. The exacerbation of emotional disturbance by 
learning problems and vice versa make it imperative to follow groups 
longitudinally. Lane and Albee (196^) , using a retrospective design, 
found that adult schizophrenics, whe.i compared to their own siblings as 
controls, had begun in elementary school to manifest difficulties in 
intellectual functioning. Obviously not all children who have difficulty 
in school become schizophrenics, bux a long range prospective study 
(rather than a retrospective one) might enable educators to develop pre- 
diction and instructional programs while children are still in their 



formative years. The existence of a hard classification schema like 
the Quay scale "will enable educators to see if there is any stability 
to the groupings, and then to measure if there is a deterioration in 
the functioning of one or more groups. 

The implications for grouping and curricular development that 
emerge from this study should be interpreted cautiously, since much 
further research must still be done, but certain tentative conclusions 
appear warranted: 

l) S£ can be grouped according to behavioral difficulties. 

This in itself is quite suggestive for non-academic curriculum building, 
e.g. 07 does not particularly need specialized academic curriculum , i.e. , 
different from that of normally functioning children, but it would be hoped 
that curricula could be devised, perhaps through desen&itization techniques 
to make the group less fearful and more able to enjoy life. Similarly 
other groups would have to learn to inhibit aggression and to learn other 
ways of obtaining attention, etc. The behavior (Q) groups show certain 
distinct patterns of learning deficits and academic curricula can de- 
finitely be geared to each group. 

2) The Quay instrument satisfactorily delineates children 
on behavioral but not academic characteristics and appears to be feasible 
for the studying of each grouping of Sg in special classes along certain 
dimensions. The instrument itself, however, seems to be in need of some 
sharpening so that it can be used with individual children as well as 



groups . 
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Appendix A ? 

ji 

BEHAVIOR PROBLEM CHECKLIST 


Col. Bo. 


Please complete each question carefully. : 


(1-8) 


1 . Hame Tor Humber) of child i 


(9-10) 


i 

2. Ace (in years) 3 

l 


(11) 


3. Sex (M 1, F 2) j 


(12) 


U. Father v s Occupation 1 


(13) 


5. Name of person completing this checklist 


(l>t) 


6. What is your relationship to this child? (Circle one) 

j 

ft. Mrvhhpr b. Father c. Teacher d. other 

(Specif) 


(15-16) 


7. School • 


(17) 


8. Grade 



Please indicate which of the following constitute problems, as far as this 
child is concerned. If an item does not constitute a problem, encircle the 
zero; if an item constitutes a mild problem, encircle the one; if an item 
constitutes a severe problem, encircle the two. Please complete every item* 
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OS) 


0 


1 


2 


1 . Oddness, "bizarre "behavior 


(19) 


0 


1 


2 


2 * Restlessness, inability to sit still 


(20) 


0 


1 


2 


3 * Attention-seeking, "show-off” behavior 


(21) 


0 


1 


2 


4 . Stays out late at night 


(22) 


0 


1 


2 


5 . Doesn’t know how to have funs behaves like a little adult 


( 23 ) 


0 


1 


2 


6. Self-consciousness; easily embarrassed 


m 


0 


1 


2 


7 . Fixed expression, lack of emotional reactivity 


( 25 ) 


0 


i 


2 


8. Disruptiveness; tendency to annoy and bother others 


(26) 


0 


1 


2 


9 * Feelings of inferiority 


( 27 ) 


0 


1 


2 


10 „ Steals in company with others 


(28) 


0 


1 


2 


11 . Boisterous ness, rowdiness 


( 29 ) 


0 


1 


2 


12 . Crying over minor annoyances and hurts 


( 30 ) 


0 


1 


2 


13 . Preoccupation; "in a world of his own" 


31) 


0 


1 


2 


14 . Shyness, bashfulness 


( 32 ) 


0 


1 


2 


15 . Social Withdrawal, preference for solitary activities 


( 33 ) 


0 


1 


2 


l6. Dislike for school 


( 34 ) 


0 


1 


2 


17 . Jealousy over attention paid other children 


( 35 ) 


0 


1 


2 


18 . Belongs to a gang 


( 36 ) 


0 


1 


2 


19 . Repetitive speech 


( 37 ) 


0 


1 


2 


20 . Short attention span 


( 38 ) 


0 


1 


2 


21, lack of self-confidence 


( 39 ) 


0 


1 


2 


22 . Inattentiveness to what others say 


( 40 ) 


0 


1 


2 


23 . Easily flustered and confused 


( 4 i) 


0 


1 


2 


24 . Incoherent speech 


( 42 ) 


0 


1 


2 


25 . Fighting 


( 43 ) 


0 


1 


2 


26 . Loyal to delinquent friends 


( 44 ) 


0 


1 


2 


27 . Temper tantrums 


( 45 ) 


0 


1 


2 


28 . Reticence, secretiveness 


( 46 ) 


0 


1 


2 


29 . Truancy from school 


( 47 ) 


0 


1 


2 


30 . Hypersensitivity; feelings easily hurt 


( 48 ) 


0 


1 


2 


31 . Laziness in school and in performance of other tasks 


( 49 ) 


0 


1 


2 


32 . Anxiety, chronic general fearfulness 


( 50 ) 


0 


1 


2 


33 . Irresponsibility, undependability 


( 51 ) 


0 


1 


2 


34 . Excessive daydreaming 


( 52 ) 


0 


1 


2 


35 * Masturbation 


( 53 ) 


0 


1 


2 


36. Has bad companions 


( 54 ) 


0 


1 


2 


37 * Tension, inability to relax 


( 55 ) 


0 


1 


2 


38. Disobedience, difficulty "in. disciplinary, ooctrol. 


( 56 ) 


0 


1 


2 


39 « Depression, chronic sadness 


( 57 ) 


0 


1 


2 


40 . Uncooperativeness in group situations 


( 58 ) 


0 


1 


2 


4 l. Aloofness, social reserve 


( 59 ) 


0 


1 


2 


42 . Passivity, suggestibility; easily led by others 


(60) 


0 


1 


2 


43 . Clumsiness, awkwardness, poor muscular coordination 


(61) 


0 


1 


2 


44 . Hyperactivity; "always on the go" 


(62) 


0 


1 


2 


45 . Distractibility 


( 63 ) 


0 


1 


2 


46 . Destructiveness in regard to his own and/or other's 

property 


( 64 ) 


0 


1 


2 


47 . Negativism, tendency to do the opposite of what is re- 
quested 


( 65 ) 


0 


1 


2 


48 . Impertinence, sauciness 


(66) 


0 


1 


2 


49. Sluggishness , lethargy 


( 67 ) 


0 


1 


2 


50 . Drowsiness 


(68) 


0 


1 


2 


51 . Profane language, swearing, cursing 


( 69 ) 


0 


1 


2 


52 . Nervousness, jitteriness, jumpiness; easily startled 


( 70 ) 


0 


1 


2 


53 . Irritability; hot-tempered, easily aroused to anger 


( 71 ) 


0 


1 


2 


54 . Enuiesis, bed-wetting. 


( 72 ) 


0 


1 


2 


55 . Often has physical complaints, e.g.beadaches, stomachache 
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